DEVICE FILTERS TABLE 



NAME 


PINS 


LOCATION 


Set top box 


VideoOut 


Living Room 


VCR 


Videoln, VideoOut 


Living Room 


• 
• 
• 


TVJ 


Videoln, Auxin 


Living Room 



PINS TABLE 



PIN IDENTIFIER 


MEDIA 
TYPE 


SUPPORTED FUNCTIONS 
(ACTIVITY VERBS) 


Set top box.VideoOut 


Video 


Watch 


VCR. Videoln 


Video 


Record 


VCR. VideoOut 


Video 


Play 


• 
• 
• 


TVJ .Videoln 


Video 


Watch 


TVJ .Auxin 


Video 


Watch 



62 



FIG. 2B 



CONTENTS TABLE 



NAME 


SOURCE 


SUB-SOURCE 


TIME (optional) 


CNN 


Set_top_box 


Channel 1 5 


Always 


1 LOVE LUCY 


Settopbox 


Channel 16 


M-F 8:00-8:30 AM 


• 
• 
• 


ABC 


TVJ 


Channel 7 


Always 



FIG. 3 



T 

80 



TOPOLOGY TABLE 



CONNECTIONS 



Settopbox.VideoOut -> TV1 .Videoln 



VCR.Video0ut->TV1 .Auxin 



FIG. 4 



90 



# 



• 



RECEIVE VERBAL 
COMMAND 



I 



600 



FIG. 6 



DETERMINE DESIRED ACTIVITY, SOURCE 
CONTENT. AND TARGET DEVICE 



I 



— 602 



DETERMINE SOURCE DEVICE FILTER — 604 



^ 606 
DOES " 
SOURCE DEVICE FILTER SUPPORT 
.DESIRED ACTIVITY' 



— 604 






608 




1 


> N ° > 


ERROR; PROMPT USER 
FOR INSTRUCTIONS 





YES 



ADD SOURCE DEVICE FILTER TO FILTER GRAPH 



I 



— 610 



DETERMINE THE NEXT DEVICE FILTER TO ADD 



.612 



ADD NEXT DEVICE FILTER —614 



CONNECT PINS AND NOTIFY DEVICE FILTERS — 616 




YES 



620 

DOES THE 

RENDERING DEVICE FILTER MATCH THE 
TARGET DEVICE ? 



NO 



622 

L 

ERROR; PROMPT USER 
FOR INSTRUCTIONS 



FIG. 7 



STEP 606 
OF FIG. 6 
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ALTERNATE DEVICE FILTERS TABLE 



NAME 


PINS 


LOCATION 


Settopbox 


PIN1 


Living Room 


VCR 


PIN2, PIN3 


Living Room 


• 
• 
• 


TVJ 


PIN4, PIN5 


Living Room 




FIG. 8 


100 



ALTERNATE PINS TABLE 



PIN ID 


PIN IDENTIFIER 


MEDIA 
TYPE 


MEDIUM 


SUPPORTED 
FUNCTIONS 
(ACTIVITY VERBS) 


FLOW 
TYPE 


PIN1 


Set top box.VideoOut 


Video 


Ml 


Watch 


Output 


PIN2 


VCR.Videoln 


Video 


M3 


Record 


Input 


PIN3 


VCR.VideoOut 


Video 


M2 


Play 


Output 


• 
• 
• 


PIN4 


TVJ.Videoln 


Video 


Ml 


Watch 


Input 


PIN5 


TVJ .Auxin 


Video 


M2 


Watch 


Output 



FIG. 9 



